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Abstract: The problem of calibrating a stereo rig is extremely important for practical 
applications. Existing work is based on the use of a calibration pattern whose 3D model is a 
priori known. We show theoretically and with experiments on real images, how it is possible 
to completely calibrate a stereo rig, that is to determine each camera’s intrinsic parameters 
and the relative displacement between the two or three cameras, using only point matches 
obtained during unknown motions, without any a priori knowledge of the scenes. 

The first part of the paper is devoted to the computation of the intrinsic parameters of 
the cameras by a method based upon the estimation of the so-called fundamental matrix 
associated with camera displacement. Three different displacements are sufficient to solve 
the Kruppa equations which yield these parameters. 

The second part of the paper is devoted to the computation of the extrinsic parameters. 
We first explain how to recover the unknown motions previously used, once we have an 
estimate of the intrinsic parameters and the fundamental matrices. The computation is 
quite robust to the inaccuracy of the determination of the camera parameters. We then 
present the equations which allow us, from two displacements of the stereo rig, for which the 
camera motions are computed independently, to compute the relative displacement between 
the cameras. This technique allows us to compute the relative displacement between two or 
three cameras and complete the full calibration of the rig. 


(Resume : tsvp) 
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Auto-calibration d’un systeme de stereovision a 
partir de ses deplacements inconnus et de 
correspondances ponctuelles 


Resume : Le probleme de la calibration d’un systeme de stereovision est ties important 
en pratique. Les methodes existantes ont l’inconvenient d’etre fondees sur l’utilisation cl’une 
mire dont un modele 3D est suppose connu. Dans ce papier, nous presentons une metho- 
dologie complete, illustree par des experiences conduites avec des images reelles, en vue 
cl’ auto-calibrer entierement un systeme de stereovision, c’est-a-dire de determiner l’ensemble 
des parametres intrinseques de chaque camera et le deplacement relatif entre les deux ou trois 
cameras, en partant uniquement d’appariements ponctuels obtenus au cours de deplacements 
inconnus, sans utiliser aucune connaissance a priori sur les scenes observees. 

La premiere partie du papier est consacree au calcul des parametres intrinseques d’une 
camera par une methode fondee sur l’estimation de la matrice dite fondamentale associee au 
deplacement de la camera. Trois differents deplacements permettent de trouver une solution 
aux equations de Kruppa qui conduit a ces parametres. 

La seconde partie du papier est consacree au calcul des parametres extrinseques. Nous 
expliquons d’abord comment obtenir les valeurs des mouvements inconnus precedemment 
utilises, a partir des parametres intrinseques et des matrices fonclamentales. Le calcul est re- 
lativement insensible a l’imprecision d’estimation des parametres des cameras. Nous presen¬ 
tons ensuite les equations qui nous permettent, a partir de deux deplacements d’un systeme 
de stereovision pour lesquels le mouvement de chaque camera est determine independem- 
ment, de calculer le deplacement relatif entre les deux ou trois cameras et d’achever ainsi la 
calibration complete du systeme. 
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1 Introduction 

1.1 The stereo calibration problem 

Camera calibration is an important task in computer vision. The purpose of camera calibra¬ 
tion is to establish the relationship between the 3D world coordinates and their corresponding 
2D image coordinates. Once this relationship is established, 3D information can be inferred 
from 2D information, and vice versa. Thus camera calibration is a prerequisite for any ap¬ 
plication where this relation between 2D images and the 3D world is needed. In the case 
of a stereo rig, calibration is needed for at least two reasons. First to establish the epipolar 
geometry of the system and cut down the complexity of the stereo correspondence process. 
Second, to reconstruct the 3-D data after matching between the retinas has been completed. 

The model which we consider is the most widely used, ft is the pinhole model. The 
basic assumption behind this model is that the relationship between the world coordinates 
and the pixel coordinates is linear projective. Thus no camera distortion is considered which 
allows us to use the powerful tools of projective geometry, which is emerging as an attractive 
framework for computer vision [32], In this chapter, we assume that the reader is familiar 
with the elementary projective geometry described in [39] for example. The equation of the 
model for one camera is: 

'1 0 0 0 ' 

= Ai 0 10 0 Di 

_ 0 0 1 0 _ 

where u. v are retinal coordinates, X , 1 . Z , world coordinates, Ai a 3 X 3 transformation 
matrix accounting for camera sampling and optical characteristics, Di a 4 X 4 displacement 
matrix accounting for camera position and orientation: Di is the displacement from the world 
coordinate system (identified to the object that has been used for the calibration) to the 
camera coordinate system. The 3x4 matrix Pi is the perspective projection matrix, which 
relates 3D world coordinates and 2D retinal coordinates. Ai depends on a variable number 
of parameters, depending on the sophistication of the camera model: these parameters are 
called intrinsic. We will consider here a five-parameter model, represented in figure 1, that 
we explain later. Di depends on 6 parameters, called extrinsic: 3 defining a rotation, 3 a 
translation, and has the form: 

Dl - (”r ‘i) (2) 

Using a second camera, introduces another set of intrinsic parameters through matrix A 2 , 
and another set of extrinsic parameters through matrix D 2 . However, in general the choice 
of a particular world coordinate system versus another one is arbitrary, the significant thing 
being the relative position and orientation of the two cameras, thus we can consider that 
there are only 6 significant extrinsic parameters for a binocular stereo rig. They are given 
by the 4x4 displacement matrix D, representing the displacement from the first camera to 
the second camera, which can be easily computed from Di and D 2 . If we don’t consider a 
coordinate system linked to an object of the world, we must express this displacement in a 






